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Abstract 

PROBLEM TO BE SOLVED: To stably estimate a conversion parameter with high accuracy for a camera 
of a type that picks up an image of an object and outputs image data by calculating the conversion 
parameter on the basis of the cross reference of pixels between the picked-up picture and a reference 
picture. 

SOLUTION: An arithmetic processing section 1 1 executes various application programs under the control 
of an operating system. First the processing section 1 1 executes a prescribed computer graphic 
processing to generate a reference picture consisting of geometrical shaped defined patterns and stores 
the reference picture to a frame memory 14. Then the processing section 1 1 calculates a conversion 
parameter of a camera on the basis of a cross reference of pixels between the picked-up picture by the 
camera and the reference picture. In the case of calculating the parameter, the processing section 1 1 
conducts picture matching processing between the two pictures. The cross reference of pixels among a 
plurality of picked-up pictures picked up by the camera is obtained by using the calculated conversion 
parameter. For example, distance is measured on the basis of the cross reference of view points in both a 
standard camera 17A and a reference camera 17B. 
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20 »^®^fl. ^(Jx.tf. m'^o:>y r ^ /i^nK. (^■Jx.fi. 

[0 0 6 8] ^mmm-^z^^^. y-^-T^sjitcf^. s 
^^(D'&m^n-^^^ y z/'^—v-a > • y<^->'t^mi^^ 

i^TV^5o ^ 1 7 aSlU^i 7 B'e:::(D=^-r y ::^'^'— 
A . ;^^y 1 4_t{c1#Sft$tu/cSipM^i:H^'g^r)-^iA 
^ (Image Reg i s trat ion) t^l'f:>tl 
30 ^ (t^ai) . 

[0069] mU:^^^^ - ^-r y T^^l^-v-a • v^^ 
^AlOfl, i£::^Tbt:) 2£(7:);^;^ ^SriSx.. T^y'U:^^ 

[0 0 7 0] ^mmms 2 0 1^. ^ij;^*^. k • 

• Vy^y (HDD) (Oi:^^^. J:be^ei];k:S4-C 

\^^xmf^ti^ sik^^vy^ • ryy '>3 > 
^(7:^^-^y y^V-^/H v^S^^T9 7ta6f7:>T:7^ 

[0 0 7 1] ;^^>r- K^-t':/2 K^. h y ryv? 

m.^y'-^^m^m^i-i>fci^(Dmmxh^o z.z.xm 

50 0 :^'f^Tt LT. MO (Ma g n e t o-Qp t i c 
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(10) 



^?fl2 0 00-3 50 239 

IS 



a 1 disc). CD-ROM. DVD (Digit 
al Versatile Disc) ^J:t^<7y^ iy^^ 

[0 0 7 2] ^7t:^2 2 (i. y — >^^S±lCp^M(7:) 
:7 3i";^ 2 3t;iJ:oTv^;^v"A i o(c^^^^^TV^5o 

[0 0 7 3] ;t-:y h!7 — • V-^ — 77 ol— 2 41^. 
;^7 7^ ^ • ^^vyi—i^B • v';^-7'A 1 0^'pJ\'^(^^ 
ff^T^n TCP/ I P (T r a n s m i 

ssion Control Protocol/In 

ternet Protocol) T^^n h n/U) (C^^o 

T:\ mmm^'P(D^^ y y v-a • yN^ — VtCOV^ 
[0 0 7 4] /^io. ^ • ^-^^ y T^V— v-B V • '>;=!v 

A 1 0 ^mm\^mj&ir^tiMat. m i u/cJi^^i^ 

[0 0 7 5] ^^feV^■T:\ C7:);^7 7< y i 7 AX\^1 7B 
^y<^^^^ti^. ^^^^^ (cx, Cy) . ^^im 



[0 0 7 6] ^-f//-^^^ — >^;55?F$ric$ixfc¥D^Sr. 
10 $:fL:^c^^^— Vfi. yyu— v/3>-^::fflv^§:2r■Yy 

[0 0 7 7] ^-r y >^3 > • '^^^^>'f^. ^fpl?f$ 
[0 0 7 8] ^:7U— A ' y^^^y^r 1 19 

[0 0 7 9] sis^sfp 1 1 -ei^. mmm<o'& 
^^cs<5v^T^-r y y v-H > • ^-^^i^t'^ 

Xyx^—M. • y^y 1 4{ClS^i-^ (;^v":yV'S 1 
0) . 

[0080] 7^V^T% S2p®«IoiS^liI^Idrac7)>c+ 

ZWim^. #t.^^^^T^|JH^::J:oTta3il^$i^^o fiL. 
r(7:>;^^v":y7'T1i. ;?7 7^ ^ l 7 AcDU>XM^t-oV>T 

f^%a;irr. 2^(rmmf^<r:>t^^-'kW'&-t^f^'<^x^ 

[0 08 1] 7J5<l^T\ SW^ I oi»«®* I dCT^FplT- 
jSSMiES'tT^ (;^-x:y:/S 3 0) . %mmHX^l^\^ 

50 — >- ([ll2^#0S(7?:it) 5:;^^^ 1 7 AT-^^L 
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[0 0 8 2] rrT\ ->^^A 1 OF^Ofi-p^SJ-J; t) 
-e-fig^tbfcSiPM^ l oi: , ^ 7 1 7 ACDm^mm. I d 

Ji~/<y:f- — 9 (cx, Cy, K, Sx) (^T'^^ttSo 
[00 8 3] :>—9W&(Dmcm^-1r^ x^iyXm.^ 

nd= [xd, yd] -^irb. V'>Xm^^^m,Lfj:\^^m^ 
mUW-m±<r)Mit^i-^.^.n^= Cxu, yu] Tt-f-^t^ 

[0 0 8 4] 
[^21 

x„ = Xd + (xd-c,>srd^ 



(1) 



[0 0 8 5] ffiU ±5tfC*5^^T. r dii^^'p.L^ 



(11) 4#SS2 0 0 0-3 5 0 2 3 9 

20 

[0 0 8 6] 
[^3] 



(2) 



[0 0 8 7] Sfc. S^Pffil^ Io±<7:».^.^no= [xo, 

[0 0 8 8] 
[^4] 



(3) 



[00 8 9] r r -C. mm^mi^mi^^ Sxs^hV y 
[0 0 9 0] 

m5] 



<4) 









yo 




yu 


1 




1 



[0 0 9 1] ±5C (1) slo^ (4) (ci:i9. mvmmi 

<.±±(D.^. n o = [ X o Ji, y o±] > StePJ* I dJicT).-^. 
nd- [xd, yd] t<Dm\a'X&.T<Dmm^'^f^^'t^o 



30 



[0 0 9 2] 
[^6] 



Xn = 



yo = 





ltd + (xj 




[+hi2 


yd+(j'd 




+ hi3 


l»3li 
1*21 1 


«d+(Xd 
Kd+(Xd 




[+h22 


yd+l^d 




+ h33 

+ h2, 


^311 


td+(Xd 




[+ ' 


yd+(yd 




+ hjj 



(S) 



[0 0 9 3] St/iaSfCj^oT. ^^^P^ — 

[0 0 9 4] *^ffi^fj-efi. ^^^'^'^^":$^(7:)lt:^ti. 

V^t^f^^^ili^a^^b-t^iA.;^^ (Image Registr 



a t i on) am^m^^^xnoo mmita^. 7k^\c^'r 

40 fpSrft/Nt:-r5r t-e. ^y<'^^—^ [hn, hi2, 

h32, h33, C X, Cy, K, S x] (D^^'^^^J 0 o 

[0 0 9 5] 

[i5c7] 



(6) 



[0 0 9 6] rc^ft/NLtC^TLTfi. Levenber 
g-Marquard t */NW£ (JWT-T:1i. TL 

S. A. Teukolsky, W. T. Vett 
erling, B. P. Planner y^(7)" NU 



50 



MERICAL RECIPES in C" (W. 
H. Press) L -M^fetCOV ^Tf£«c$tLT 

[0 0 9 7] ^mm^^=i¥\(o g a^tfi s -efo5 r t 
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(12) 



0 0 0-3 5 0 2 3 9 

22 



**-, h32, c X, c y, M , s x] = [mi, ms, m 

11, mi2] tmm-t^^itti-^ (-r^^io-hhss^wm 

[0 0 9 8] L-Mffitc:t¥3r/i-=^'y XA-r:1i. ^^(7) 

[0 0 9 9] 
[^8] 

^ = + ... (7) 

[0 10 0] fab. ±^ (7) (;l^6^/^T. (a i o/a 

xo, a lo/^yo) fi.-^. (xo, yo) -ecO»^^ia^ 

f "iififfl Hessian Matrix aiWeigh 
ted gradient Vector i3 SrW+^"t" 

[0101] 
[»9] 

[0 10 2] #*Si9iilb^l?^iC*DV^T. _hfa(75#^^^^ 

[0 10 3] 
[ici 0] 

Am = (a+ AI)"^ ^ O) 

[0 10 4] ±5*: (9) i;ijSV^T. Xfit ime-va 
rying stabilization pararn 
e t e rT-fo-5» ISMe i;4S5fE5>/h$ < ^iS*T-M^A 

[0105] 1 ) MiMMiMi I d-h«#®*ndi = 

[xdi, yd,] T(CMLT, 

5t (5) ^fflV>T^mt-5c 

<2>»i^mi^ I dS.t/S2i®^ I oCo>Fj-^£;-r5iii*raco»^ 

m^ieitM^mi id Io/5xo, 5 Io/5yo) ^ 

(7) (ctj^oT^m-rs., 

(^S2) i*: (9) iZ7fk]^ti~y;^y'M.:fjU^^M^. * 



= 1, 2, 1 2) o 

(MS 3) ^ (6) {Cl^U7t»a^^<7)2*?P^Si:g:?)DL 
fc^-^. 1 Of^LT. mm.2) (CM 

5„ ti*DL:^i/i^o7t«^«. 1^1/1 01^ LT, (M 
ai) (CMS, 

[0 10 6] aJi<7)MS(Cj: I? . ^^^y^y^—^CDm 

0 lcio^^T#®-te I o^U? I dralT'»^lijE$:HfiMa^; L 

[0 10 7] mM^iE-:)jm<o-m^. us ^#.33^/^755 
[0 10 8] mmm^io±.(D^mm-'<^~->'<v 

yu—iys > • y<^~>'\-i'^:^'rJ>~ 1 0l^<^t|-^MS(c 
#5,^Sra^?^nfcV\ HIS (a) co#|glff^^^<5'— ^'Ji 

30 (Dt-r^o 

[0 10 9] ^U«W,^^^^T?lJHo^fflV^T. 
[0 110] rtb4T'(4, CD;*?;^ 7 1 7 A{rol/^T 

( 0 1 1 1 ] 0 6 (dtt. u:ir • -<T^mm.-r^mm 

[01 12] HI 7 (C{4, P^T^ 1/:^ • ^T;45^^-f-5fl|^ 

^±m^hmm\^tcm'iF-i7jii.x\^^?>. z.(r)y^y-\y^^ 

50 rBl±IC(4. «^^®(75SEg«ISrftaiJ-r5J^,^>f4g;ii5fc5co 



(13) 

23 



mm:^ ^ ^ i 7 a t m^^m t <d^.^. p 

o*^. mmtf;^^ 1 7 A<Dmim\i^ I A±T1^,^.nHi: u 
Tm«^ti^;5\ #BS;^^ 9 1 7 BcD«^BJ'^ I B±-rr 

[0 113] mm.mmiAt int^mn^t^'^tzt^^c 

m^-D^rJi^iA^ (Image Regist 
rat ion) fC J: o Tf+g-f-^ ^ ^ ^^"C^ 

LT. mi^mm I A ^ I B ^ ^Mf^^io^fc t ^ ^cmm<r) 

a^'i^'^^^ (Image Regi s tra t ion) 

[0 114] itim^m:mm^r^^^.o^mm-r^^t\cx 

Mi-§ti«ffi^ I BJiCO>f+^c::.<^.ndi^t+-»-r^ r t:^^^X 
[01 15] mmti?^ y 1 7 AcT^lS^Bl^ I aCT^M^.-^. 

nb(i. il^^®;6^ggsf Zo&(:/^Zic7:>^^{c:fc^^ 
^ 1 7 B(Djl^iij^ I BJi-efi^fL^etL.-^. 

vmK\zm^mm^n~r:\^^mm?^'^ - 207943-^ 

5:I/4#ii¥9 ~ 2 0 7 9 5 1 -^cO^^^^^B»^CgB7F$t^X 
[0 116] :^y'V'Mk\z.X.^^mm&^n^'t^fz.^ 

trans 

-So 

[0 117] r»S^s§i5i i"e(i. ^{pr?fm(7^:e 

rcO'g'/^5c:®te$rS^®^Io<t: bT^^U— ■ 
y 1 4fC|&^-r5 (^^:y:/S 5 1) o 
[0 118] 2^1/ ^^^->';55?F^^S:$tLfc^ffi^. S 
y 1 7 ARXim^mti :^ y 1 7 BtCioXffi^t^ 
^ ^ 1 7 A&t>^ 1 7 B 7)5a^ LfcSf^^^®^ I A 



1#P?fi 2000-350239 
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Rxi I B*i. :7 A • ^ ^ y 1 9 tc— 

(^T^:y:7^S 5 2) o ^Sit-^F^J^^ttfc/^^-Vfi. 
y ^>3 >'^;Ifflv^§=^^ y s^a v • 

:7i/^A • ;^^y 1 A±.(7^mmm^^mm\^t:ih(0'Qh 
[0 119] ^^-^yz/v— i/av • y<^—iy\^^ minm 

(D'ri:^::^^^H^^mt^:^?^y 1 7 A^t>n 7 B^Tr 

[0 12 0] 7^\.^x\ mmmmi<.tmmmmi^t(D>-t 
Jt^m^^(r)^mm^m'&-t^ (^v^:y:/s 5 3 a) , rc^ 

20 rcOB#.'^.-e(^. 1 7 AfT^lxVX^^fCOV^T 

[0121] iSfei/^-e. iij^-^fci±-iA^*iiS^5a^6ti_§-o 

i«MSMT 9 Acinic. iS#®^ I ACOWSffl^ffl V ^TS 

mmuic.(Dmmm^m^'r^ (:^^:y:/s 5 4a) , 

[0122] L-Mf£^fflV^Tili^^t5itiA^ 
(Image Regi stra t ion) Sr?TV #t 

^^-^^fT^ijHAt^^/^^y— KA, CxA, CyA^WM 

30 (;^-7^-/v^S 5 5 A) o mt. ka(^:^>^17A 

<7:>u>X3i;^?.>^.^-C'fot9. .-^^ (CxA, c^a) fiuv-xco 

[0 12 3] S7t. te:fe^CD#BB:;^7^ ^ 1 7 B 
lB(c^+LTt.. (WHttc. a*Ili^Ioi:(Z)*J-/^;P^^.O^;] 
MtttT)^^ (;=^v^:yXS 5 3 B) . «^M^ I rCD®;^ 

4B) . SI>\ W^^^mfT?iJHBi:^;^/^^7<-^^B, 
40 CxB, CvB^T^^dB (^^•T'^y^S 5 5 B) ^tT^o 

[0124] 5^ 1 7 A(DmUmm. I A;^^?^#fiS 

7« y (T^ii^M^ i B--^?:>t^^^^^T?^JH^r3n3fl. Ha 
xH-lB^:l^9?f^-Tr*-t■r (^^^/:/S5 

^ACA, CxA, CyA^fflv^T»^^l^feI Acos;^^i^*-r 

5 (^^:y:7'S5 6) iirfctd. — :^ /ce, 

CxB, CvB^ffli/^Til^Mte I Bt@^(7)^;^?:#ipi-^ 

(;=^-r:y7/S 5 7) ^ 

[0 12 5] 7i4b\ ®^-^fci^ii^S:tT5l^t-. -^tL^^ 

50 ti.f^i®^c7:)j^^^^-ife$i±^i^.^;dsfo5 (i-?tei^-^. 
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(14) 



#§12 0 00-3 502 39 
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1 7A^t>*l 7BCO€-^CC)S^Bi^lA, I b{::*5 

[0126] [ilM] Jii_h, #^i7?|||g^J?:#BB Lifc;6S 
[0 12 7] FiJ;t(±\ ^^^ffi^ijT-(i, »^ill^;4-e>»2p 

[0 12 8] m7jit\^^oMmx^^m^m^ 

[0 12 9] 

[01 3 0] ^7t. i^kcDmmmm^ 
S{c^:£Jaoitiltg^c/^°7 —^w^^n a^x^ 

[0 13 1] ^wnxii. mm^ciJ ^ yxmi^Ltzmik 
mmz.M\^x. $mm\f^x-^i$.Lfzy<^->-t^j:t>ibm 

-^m^^-tt>-t^'^t^:Lt'(CX-^x. ^60^-^°^^— 
[0 13 2] *^P^(CJ;tLtt\ ^F;fW^=e1#m-^.Srfflv^-r 

[0 13 3] *7t. ^-r y :7i/-->3 Xcfflv^s^^'i^' — 
(15'i);t(±\ em 2 fe(7>rtTfc^m«. 2fi:co3:ft?i?ro,ia;^-g- 

-f-^^fl. -g-J*Lfc^-?<5'— >-i[5I— c^/-?^- >-^f#oJp 



[0134] =3f-^ y ^^u— >3 
mm i^x^^vyi^—i^a >-^no=.thx^^o 

[0 13 5] */c. m^^<9 ^(—^(OWtiitmmz^ 

^Lfc2^Aroii^iii^(^PLT. -:>7<Dmi&mut&m 
mm. t ^MfcMi-f ^^mw^'t. mj3<^m^m^ t mm 

^■r 5 r i: {c i ox. 2 tS:(73lt^iiitefBi(75^^E:r#R^* 
465 r. i ;55x-# 5aRXfe5„ 

[0 13 6] 3|s:a:il^A^::|^^'llS^$^^XV^5# 
9-207948 ^-^^mW- 9-207951 -^(75 

20 a*■^fe{co^^xM^^:bX^^5;4^ r:ttb<7)jij^^S^g 

m 1 ] *^0^co|IS6tc^$n5;<7p< 5 • y :7V— 
L/cl2IX-fc5o 

[0 2] *^B;§(C'(S5y!7;'«7 • ^i'y:7V-v'3>'{c:ffl 

Xfc5e 

[m 3 ] m.^^^'7P>-—^m.-s.(D^nmm^mmm^^- l 

30 7t7ci-^-r— hXfcSo 

L7t'bWX-$>'5„ 

[la 5 ] mmmm. i o^tm^ss^ i ^mx^mmmiEn 

[me] ;^-7^u;*- • ■-<T?:Pfi)c-r5S2p;<7;><^ 1 7Ai: 
#Ba;*7 ^ 7 1 7 B co#^ . 2 «cO m«;^^4^W7^ 
^ M# ¥S^#^-t-5l«^ ?r7]^ LTtUXfe -Sc 

[1117] ■ ^T^mm.-t^mmti^i'y 1 7Ai: 

#BS;^;p< 7 1 7 B(^#^ ;452p®^*^i-5«^^^. Ji® 

[me] ;=^7'^:^ • -<TIC>ffLX^^^<^;^— 
^S#)ilSr«tB&S<){C7j%Lfc7c2— ^-^— hX'fc^c 
[0 9 1 7* 7 1 7 A&t>'#B§;{7 p< 7 1 7 B <73S^ 

[m 1 0 ] »^*J-*(c:5?j-r5£*;«7^ 7 7<75 

[011] BgJE;^ff$l^/^°^ — t#f®77^ 

50 [mi 2] 3it°jJf— 7 • vt, #BS,ili^'t'(e:*5!t'5 
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1 12--RAM. 13--ROM 

1 5-"A;^^s 1 6---*7r:g{5 
1 7 A, 1 I'Q'-ti:^^ 



(15) #§B2000 
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1 9 -*:7i/"A • ;^^y t 

2 0---^1^^?SlS^B (HDD) 
2 1---;^T^VT • K^-f 



3 5 0 2 3 9 



2 2- 
2 4- 



•^S^t^. 2 3- 





(17) 1#P?fi2000~3 5 0 2 3 



[HI?] 



[El 91 



it A, Cx*. Cyj^ 




imio] 




a>WM>Cd 



(18) 



2000-350239 



ims] 



S 5 3 A 



^ START ^ 



S 5 1 



S 5 2 



I 



S 5 3 B 



S 5 4 A 



S 5 5A L, 



S 5 4B 

2^ 



S 5 5B 



S 5 6 



S 5 7 



S 5 3 



(19) 



4#SB 2 0 0 0 - 3 5 0 2 3 9 



[mi 2] 




:7n>' h^—i^(7:>M.^ 

F^— 5C022 ABi5 AB51 AB61 AC03 AC04 
AC69 AC76 CA02 
5C061 AB04 BB03 BBll CCOl 
5L096 AA07 BA08 CA03 CA22 DA02 
EA12 EA26 EA31 FA22 FA32 
FA38 FA42 FA54 FA67 MA03 



